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I. Basis of the report 



1. 



Description, Pages 

1 ' 3 ' 5 " 26 as originally filed 

2 ' 4 received on 28.06.2004 with letter of 28.06.2004 

Claims, Numbers 

1 " 1 4 received on 06.08.2004 with letter of 06.08.2004 

Drawings, Sheets 

1/7-7/7 as originally filed 

These elements were available or furnished to this Authority in the following language: . which is: 

□ the language of a translation furnished for the purposes of the international search (under Rule 23.1 (b)) 

□ the language of publication of the international application (under Rule 48.3(b)) 

D meSifXto^** 0 " 1 UmiShed f ° r the pUrp ° Ses of 'ntemationa. preliminary examination (under 

3 - ~, the 

□ contained in the international application in written form. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority in written form. 

□ furnished subsequently to this Authority in computer readable form 

° l^Z^X^^^^^ — so beyond ,he dtedoeun* 

° Srn^Sn^mfened 0 "™" 0 '' ' eC °" > ° 3 COmpUter readabte ,orm ls <° »» »n«sn sequence 

4. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 
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This report has been established as if (some of) the amendments had not been made sine* thn, h*„ a 
been considered to ao bevond the disclns.iro J* si^h tc.,~ ™ o/*u een maae ' since tne y nave 



go beyond the disclosure as filed (Rule 70.2(c)). 
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Re Item V 

Reasoned statement with regard to novelty, inventive step or industrial 
•ility; citations and explanations supporting such statement 



Reference is made to the following document: 

D1 : WO 97/46027 A (SARNOFF CORP) 4 December 1 997 (1 997-1 2-04) 



The document D1 is regarded as being the closest prior art to the subject-matter of claim 1 , and 
shows (the references in parentheses applying to this document): 

a method and apparatus of generating a mixed media stream from input media streams 
(D1, page 1, lines 10-12) having payload data elements and related identifiers, comprising 
the step of aligning the input media streams according to a pre-specified relation between 
identifiers in different input media streams (the offset of the PTS for the video respectively 
audio access units in D1 , page 8, lines 5-17) 

from which the subject-matter of claim 1 differs in that 
(see characterising part of claim 1 ) 

the pre-specified relation between identifiers in the media streams of a first type is 
matched to a relation between identifiers in further input media streams of a second type 
used during generation of a further mixed media stream from the input media streams of 
the second type, and the matching of relations between identifiers in the media streams of 
the first type and the further input media streams of the second type is achieved by 
identifying an intersection between the input media streams of the first type and the 
further input media of the second type, determining a relation between identifiers in the 
further input media streams of the second type for those further input media streams which 
are comprised in the intersection, aligning the input media streams of the first type 
which are comprised in the intersection according to the relation of identifiers in the 
further input media streams. 

The subject-matter of claim 1 is therefore new (Article 33(2) PCT). 

The problem to be solved by the present invention may therefore be regarded as the generation 
of mixed media streams by generating them with the related input media streams being aligned 
according to the same relative relation between identifiers. The generated mixed media streams 
are generated using the same relative relation between identifiers in the related groups of input 
media streams. 
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No single prior art document nor a combination suggests or hints at the problem of generating 
mixed media by exploiting the relative relations between identifiers and intersections between 
the input streams when several output streams are generated. 

The solution to this problem proposed in claim 1 of the present application is therefore also 
considered as involving an inventive step (Article 33(3) PCT). 

Claims 2 until 7 are dependent on claim 1 and as such also meet the requirements of the PCT 
with respect to novelty and inventive step. 

Claims 8-13 describe an apparatus having means (units) which perform the method steps as 
disclosed in the corresponding claims 1-6 and the same novelty and inventive step observations 
as above apply, mutatis mutandis. 

Claim 14 describes a computer program product directly loadable into the internal memory of a 
mixer unit comprising software code portions for performing the method steps of one of the 
cla.ms 1 to 7, when the product is run on a processor of the mixer unit and the same novelty and 
inventive step observations as above apply, mutatis mutandis. 

The proposed method, apparatus and computer program product are industrial applicable in the 
field of processing of digital data. 
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. Currently,, the" matching of such video and audio or in more - 
• general sense mixed media streams require a complicated 
procedure. Normally, time stamps are used," e.g., as outlined 
in WO 97/46027 or US-A-5 , 661 , 665, which will be attached to 
the different signals to enable the matching of the related 
media streams. However, while this at least is some mechanism 
to a match the mixing of different media streams , currently, 
there does not exist any. solution to the problem how the 
generation of mixed media streams of a .different type, e.g., 
a mixed video stream and a mixed audio stream may be 



SUMMARY OF INVENTION 

In view of the .above, the object of the present invention is 
to provide a mechanism for coordination during generation of 
a plurality of mixed media streams. 

■ • 

According to the present invention, this object is achieved 
" through a method of generating a mixed media stream having 
the features of claim i; 

■ * 

In the sense of the present invention a media stream is 
generated in a packet switched transmission, .process typically 
by a user end equipment. One example of an input media stream 
may be a voice data..packet stream -or a video data packet 
stream which is generated in a video 



Here, use is made of identifiers being available in. the input 
media streams. As outlined above, in each media stream there 
are" available identifiers defining an. order of data packets . 
in that media stream. The same also applies for all other 
input media streams which will finaliy be used to generate a 

mixed media stream. 



Therefore, at a certain point in time one may consider a 
tupel of such identifiers in each input media stream as a 
relation which may then be compared to a pre-specified • 



■ 

In other words, each such tupel defines a relative alignment 
of input media streams which may be changed according to a 
pre-specified relation either through advancing or delaying 
input media streams in time: ' 

Therefore, the result of the. inventive method is a ' 
modification of the relative alignment of input media streams 
according to a. pre-specified relation of ordering for the - 

« 

oerore generating the mixed media 
streams. It should be noted that such an alignment is related 
to the relative alignment of input media streams only and 
does not rely' on absolute time. 



Also, according, to the present invention the pre-specifi 
relation between identifiers in different input media streams 
is matched to a relation between identifiers in further input 
media streams used during generation .of a further mixed media 
stream. 
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